Facial features motion analysis for wire-frame tracking in model-based moving image coding
نویسندگان
چکیده
This paper addresses the problem of wire-frame tracking by accurate analysis of the motion and the shape of the facial features in head-and-shoulders scenes. Accurate wire-frame tracking is of paramount importance for correct reconstruction of the encoded image, especially in the areas occupied by the lips and the eyes. An entirely new algorithm for tracking the motion of a semantic wire-frame (Candide) by analysis of the principal components of sub-images containing important facial features of the speaker's face is proposed. This algorithm is suitable for tracking both global motion (motion of the speaker’s head) and local motion (motion of the facial features). The algorithm was tested on numerous headand-shoulders sequences with excellent results.
منابع مشابه
Analysis and Synthesis of Facial Expressions by Feature-Points Tracking and Deformable Model
Face expression recognition is useful for designing new interactive devices offering the possibility of new ways for human to interact with computer systems. In this paper we develop a facial expressions analysis and synthesis system. The analysis part of the system is based on the facial features extracted from facial feature points (FFP) in frontal image sequences. Selected facial feature poi...
متن کاملGlobal Motion Estimation in Model-Based Image Coding by Tracking Three-Dimensional Contour Feature P - Circuits and Systems for Video Technology, IEEE Transactions on
Recently a new type of video coding method called model-based image coding has attracted much attention as a potential candidate for low bit-rate visual communication services. This technique reconstructs the facial image with a preknown three-dimensional (3-D) human face model and its received model motion parameters. The parameters of the head motion are mainly divided into two parts: global ...
متن کاملAutomatic fitting and tracking of facial features in head-and-shoulders sequences
Model-based video coding requires the application of both image processing and machine vision techniques for proper fitting of the semantic model and its subsequent tracking throughout the rest of the sequence of a certain type (e.g. ‘headand-shoulders’ or ‘head-only’). A method of automatic semantic wire-frame fitting and tracking based on principal component analysis using an independent refe...
متن کاملNeural Network Performance Analysis for Real Time Hand Gesture Tracking Based on Hu Moment and Hybrid Features
This paper presents a comparison study between the multilayer perceptron (MLP) and radial basis function (RBF) neural networks with supervised learning and back propagation algorithm to track hand gestures. Both networks have two output classes which are hand and face. Skin is detected by a regional based algorithm in the image, and then networks are applied on video sequences frame by frame in...
متن کاملSegmentation and Compact Representation of Moving Objects in Facial Image Sequences
|This research addresses the problem of moving object detection in image sequences, with application to very low bit rate video coding. An approach to segmentation of moving objects in facial image sequences is presented. In this approach a split-and-merge procedure is used to resolve the di culties arising out of the mutual dependence between motion estimation and segmentation. The basis of th...
متن کامل